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Let X„ = ^^jai£„_i, where the Si are i.i.d. with mean and at least finite second mo- 
ment, and the a; are assumed to satisfy \ai\ — 0{i~^) with (3 > 1/2. When 1/2 </?<!, Xn 
is usually called a long-range dependent or long-memory process. For a certain class of Borel 
functions K{xi, . . . ,2:^+1), d>0, from 7?.''^^ to TZ, which includes indicator functions and poly- 
nomials, the stationary sequence K{Xn,Xn+i, . . . , X„+d) is considered. By developing a finite 
orthogonal expansion of K{X„, . . . ,Xn+d), the Berry-Esseen type bounds for the normalized 
sum Qn /\fN ,Qn = J2n^i(^(-^^' ■ ■ ■ ,Xn+d) -EK{X„, . . .,X„+d)) are obtained when Qn/VN 
obeys the central limit theorem with positive limiting variance. 

Keywords: Berry-Esseen bounds; linear processes; long memory; long-range dependence; 
non-instantaneous filters; rate of convergence 

1. Introduction 

Consider a linear process X„, n = 1, 2, . . . , defined by Xn — X^i^i <^i^n~i: where the £i 
are i.i.d. having mean and at least finite second moment and the are assumed to 
satisfy \ai\ = 0{i~^) with f3 > 1/2. Let K{xi, . . . jX^+i), d > 0, be a Borel function from 
7^'^+l to TZ. For fixed d>0, define Qn = E^Li(-^(^n> • ■ • > ^"-hd) - EX(X„, . . . , X„+d)). 
The present paper aims to establish the Berry-Esseen-type of rate of convergence for 
Qn/V1^ when Qn/^/N obeys the central limit theorem with some positive limiting 
variance cr^, that is, to determine a positive real number s such that the uniform dis- 
tance sup^ \P{Qm /VN <x) — <^{x/a)\ between the two distributions P{Qm/VN < x) 
and ^{x/a) is 0(iV~*) as N tends to infinity, where $(•) is the standard normal distri- 
bution function. There is abundant literature investigating the same problem for i.i.d. 
sequences or stationary sequences which are weakly dependent (short-range dependent or 
short-memory; see Bradley [4] for a review on sequences of weak dependence). For the for- 
mer, comprehensive studies are given in, for example, Gnedenko and Kolmogorov [7] and 
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Petrov [18]. For the latter, which includes the case of m-dependence, a detailed account 
of related results can be found in Sunklodas [22]. With an emphasis on the statistical 
inference front, Bentkus, Gotze and Tikhomirov [1] studied the Berry-Esseen bounds for 
a general class of asymptotically normal statistics constructed from absolutely regular 
random variables. In addition, considering a Gaussian linear process, Taniguchi [24] stud- 
ied a problem similar to ours and derived a bound of order 0(iV~^/^) by assuming that 
(3>2 and that the functional K is of the form K{x, y) = xy. There are three features that 
distinguish our setting from those in the literature mentioned above. First, the function 
K need not be smooth as considered in Taniguchi [24]. Second, the sequence n > 1, 

is not necessarily Gaussian. Third, the dependence structure of is determined solely 

through the decay rate \ai \ = 0{i~^) of the innovation cocfhcicnts without assuming any 
mixing-type condition, which is in general, difficult to verify. Moreover, when (3 £ (1/2, 1), 
{X„} covers a widely studied class of long-range dependent (or long-memory) processes 
(cf. Brockwell and Davis [3]) which is not strong mixing (Rosenblatt [21]). Note that 
the mixing- type conditions are not satisfied by long-memory processes with /3 < 1 , but 
also sometimes fail to hold even when the hyperbolic decay rate /? is greater than 1 (see 
Bradley [4], Phan and Tran [19]). With the same setting of non- instantaneous function- 
als and linear processes, but mainly dealing with the short-memory case were /? > 1, 
Wu [27] proved central limit theorems for Qiq/^fN by treating the innovation sequence 
{...,£„_!,£„} as an infinite-dimensional Markov chain. When {X„} is long-range de- 
pendent with l/2</3<l, it is important to note that the asymptotic behavior of Qat 
depends very much on the function K. Although the variance var(^j^^j^ X„) of par- 
tial sums of XnS grows with the rate 0{N~'^^^^), it is possible that yoi^Qn) = 0{N) 
for certain X's and that the root-A^ central limit theorem holds. To prove this central 
limit theorem for Qn/V^, the standard approach is to expand K{Xm ■ ■ ■ ,Xn+d+i) in 
terms of polynomials, provided that either {A„} is Gaussian (Ho and Sun [15]) or the 
functional K under consideration is smooth (Giraitis [8]). To deal with the case where 
both assumptions fail, Ho and Hsing [14] introduced a new method based on martingale 
decomposition to prove the central limit theorem for instantaneous functionals which 
include indicator functions and polynomials. In order to refine the central limit theorem 
by giving Berry-Esseen bounds for the rate of convergence, we shall combine the mar- 
tingale method proposed in Ho and Hsing [14] with the blocking method (Bernstein [2]). 
The latter has been extensively used in studying the asymptotic behavior of the sum 
of weakly dependent random variables. It is known that under the weak dependence, 
the rates achieved by using the blocking method is not as sharp as those achieved by 
the Stein-Tikhomirov method (Stein [23] , Tikhomirov [26] ) which involves using a linear 
differential equation in terms of the difference between the distribution (characteristic) 
function of the sum of weakly dependent random variables and that of a standard nor- 
mal random variable. However the blocking method is still an appealing technique in 
our setting since the Stein-Tikhomirov approach is hard to apply in the case where the 
condition of weak dependence no longer holds. 

The main contribution of the present paper is the derivation of the Berry-Esseen 
bounds (given in (5) and (6) in Section 2.2) for the class of stationary sequences gener- 
ated by applying a nonlinear transformation to linear processes that are allowed to be 
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long-range dependent (when l/2</3<l) or short-range dependent (when I < f3), but 
need not satisfy any traditional mixing-type condition. The bounds will depend on the 
functional K as well as on the decay rate (3 of the coefficients {ui}. It is known that 
the Berry-Esseen rate established for independent or m-dependent sequences is of order 
0(Ar-i/2) (Gnedenko and Kolmogorov [7], Petrov [18] and Stein [23]). For weakly depen- 
dent sequences such as sequences that are strong mixing, absolutely regular or completely 
regular, the rate is bounded by 0(A^~^/^ log^ A^) provided that the mixing coefficients 
decay exponentially (Tikhomirov [26] and Stein [23]). While previous results in the liter- 
ature require that the sequences be independent or weakly dependent, we demonstrate 
for the stationary sequence {K{Xn, ■ ■ ■ ,Xn+d)} that the Berry-Esseen bounds can still 
be obtained, even when the underlying process is long-range dependent. Although the 
rate we achieve is slower than 0{N~-^/^), it is as good as those shown for a certain 
class of strong mixing sequences whose mixing coefficients decrease hyperbolically to 
zero (Theorem 1, Tikhomirov [26]). 

The rest of this paper is organized as follows. In the next section, following the introduc- 
tion of some notation and technical conditions, arc the statements of our major results. 
Theorems 1 and 2, which deal with the long- and short-memory cases, respectively. To- 
ward the end of Section 2, we present two commonly seen examples, zero crossings and 
lag covariances, to illustrate the results. Section 3 presents the proofs of the theorems, 
which make frequent use of two technical lemmas that are presented in Section 4. 

2. Main results 

Before stating our major results (Theorems 1 and 2 and Corollary 1 in Section 2.2), 
wc give a brief description of our approach. Define Z„ ~ K{Xn,Xn+i, . . . , Xn+d) — 
EK{Xn, Xn+i, . . . , Xn+d) and Xn,7n — ^^i^n-i- We first extend the martingale de- 
composition technique introduced in Ho and Hsing [14] to the case of non-instantaneous 
functionals to establish that there exist an integer r > 1 and a real sequence {f'ji,....^,,} 
such that the sequence of autocovariances of the sequence {Zn} decays with the same 

rate as that of J2d<ji j <oo ^ii^- - Jr Olii ^n-l-<i-js • Here, the integer r is determined 
by the functional K and the underlying sequence {Xn}, and the coefficient bj-^ 
is asymptotically of order 0{ji'^ ■ ■ ■ j^^)- Suppose that 1/2 < /? < 1 (the long-memory 
case) and r(2/3 — 1) > 1. It is then clear that the sequence of autocovariances of {Zn} 
is summable, that is, X]fc°=o ^ This property suggests that even when 

is long-memory, one can apply a certain nonlinear transformation to it to obtain 
a sequence {Zn\ which behaves like a short-memory one and which obeys the central 
limit theorem. Based on this, it is then plausible to approximate Z„ by ^n,f(Ar))j with 

Zn,l{N) ~ K{Xn^l(N):^n+l,e{N)i ■ • ■ i Xn+d.e{N)) {Xn^e{N) t ^n+l,e{N) : ■ ■ ■ i Xn+d.e{N)): 

where i{N) increases to infinity at an appropriate rate as N oo. For fixed and suit- 
ably chosen increasing sequences {i{N)}, {kpf} and {Atv}, we adopt the blocking method 
(Bernstein [2]) to select fcjv disjoint blocks of Z„.^(Ar)'s from {Zi^(jv)i • • • i ^Af,^(Af)}- each 
having size An, such that these blocks arc sufficiently far apart from each other and thus 
mutually independent. Our results then follow from deriving the Berry-Esseen bound 
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for the independent blocks and letting the N tend to infinity. The specific form of 
^ii.- -,ir's and the precise values of k^, In and An will be given in the next subsection 
and during the course of the proofs, respectively. 



2.1. Notation and technical conditions 



For u>l define {d + l)-dinicnsional vectors of partial differentiation operators as 

A -I^A A A ^ 



_ f-, ! ■ ■ ■ ; ^ — tt, L-r^ f-i 
ox I OXd 



+ 1 



where 



a„_(rf+i_„), if u-(d+l-u)>G, 
0, if u-(d+l-u)<0, 



for 1 < w < c? + 1. For example, 

d 



Ai = 0,...,0,a 



^ dxd+i 



0, . . . ,0,ai- — , ... ,02- 



and for u>d+l, 



Also, define 



and for r > 2, 



dxd ' " ' ' i9a;d+i 



dxi dxd^ 



d+l g 



Ui,....Uj~ — l 

where jdxu^ - ■ -dx^^ denotes partial differentiation with respect to the variables 
Xuj, . . . , a;„^, r times. That is, for any smooth function G(-), 

D X A A d''G{xx,.-.,Xd+\) 

Aj,^„, • • • Ajv^„„^j- ^ . (1) 

Recall that X^j ~ X^i^i ^i^n-i- For 1 < j < oo, define X^j = — X^j and 
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Let 

X„ = {Xn,Xn+l, . . . , X„+d), 
X = (Xi, . . .,Xd+l)- 

For 1 < J < oo and fixed d, let [j] denote the set of d + 1 indices {j — c?) V 0, (j — d + 
1) V 0, . . . , J — 1, J and the joint distribution function of Xij-. Note that X„.oo = X„, 
that i*"[oo] denotes the joint distribution of {Xi, . . . , Xd+i) and that if any index in [j] 
is zero, its corresponding distribution is set to be a point mass at zero with probabiUty 
one. Define 



K[j]{xi,...,Xd+i)= J K{xi+ui,...,Xd+i+Ud+i)dF[j]{ui,...,Ud+i) 
or, in abbreviated from, 

/<[,](x)= I /<(X + U)di^[,](u). 

Let i = (ii, . . . , id+i)- We denote the ith partial derivative of K^j^ {xi, . . . , Xd+i) by 
, . d^^'-'^-^^Ky^{xu...,Xd+i) 

^mi^^---^-^) = ^^^—^l 

whenever it exists. Define Z^fl = -?VEif (X„) and for r > 1, 

TV r 
n— 1 l<ji<---<jV<co s— 1 

and 

Af p 
QAr,p = ^A'(X„)-^Z7v,r, P > 0. 

Note that for the instantaneous case, that is, = 0, Bjj...j^ o A'oo(O) = • • • aj^Koo{^) 

and ^'at,,. = A'oo(0)X)!LiEi<ji< - <><oc.nl=i«i=£n-i=' which is precisely Koo{0)YN,r 
as defined in Ho and Hsing ([14], page 1638). 

Below are some regularity conditions that will be needed for the results stated in the 
next subsection. Let i = (ii, . . . , id+i) and x = [xi, . . . , Xd+i)- 

(CI) For a certain positive integer J, the partial derivatives i^j'^^^j^j (x) of K^dj\-i]{'^) 
of order i = (ii, . . . , id+i) with < ii + • • • + id+i < J + 2 are continuous and one of the 
following two conditions holds: 

(i) K^[d+i\{^) is bounded and Eef < oo; 
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(ii) iiTj'^^j^j (x) is unbounded, but there is a polynomial function C/i(x) of degree M 
such that |A"j^^^](x)| < |[/i(x)| for all x e 7^''+^ and Ee'"''''^^'''^^^ + W^{Xi) < oo. 

(C2) E[A'(Xi)-A'(Xi,f)]2^G as £^oo. 

Condition (CI) that describes a concrete class of transformations K is not presented 
in the full generality as given in Ho and Hsing [14] , yet it covers most of interesting cases 
in the literature. We choose to use (CI) merely for presentational simplicity since our 
main purpose is to introduce a method to obtain a rate of convergence in the current 
setting rather than to seek a class of transformations K as general as possible. Note that 
in part (i) of (CI), indicator functions are included if the distribution function G of ei 
is sufficiently smooth. Condition (CI) ensures the following useful property needed later 
for proving theorems: for (ii, . . . ,id+i) with < ii + • • • + id+i < J + 2 and j > d + 1, 
continuous and satisfies 

i^£f--'^+^)(xi,...,Xd+i) 

(2) 

= / K^j'Si{'''^'\xi + yi, • ■ • , Xd+i + Vd+i) dGj-divi) ■ ■ ■ dGj (yrf+i), 

where G„ is the distribution of a„ei. (2) can be shown by using an argument similar 
to that used in proving Lemma 2.1 of Ho and Hsing [14]. Condition (C2) is a technical 
assumption and seems to be a natural assumption for the ^-truncation argument we 
employ in Section 3 for proving theorems. 

2.2. Theorems 

In characterizing the limiting theorems for the case of instantaneous transformations. Ho 
and Hsing [14] proposed a quantity called power rank, which is analogous to the Hermite 
rank when Xt is Gaussian. In the following, the multivariate version of the power rank 
is introduced for non-instantaneous transformations. 

Definition 1. We say that the d+ 1-dimensional transformation K has power rank 
V if all of the partial derivatives /\ j^^J'"'*''^^'' (0, . . . , 0) of Xjooj (0, . . . , 0) of order 
«i, . . . ,id+i with ii + • • • + id+i = s <v exist and the following conditions are satisfied: 
if j^^j'"'*'*^^'' (0, . . . , 0) = if ii + ■ ■ ■ + id+i ^ s < V , and there exists [i'l, . . . ,i'^j^i) with 

i[ + ■ ■ ■ + i'j^^i — V such that K^^^ "' ''^^ (0, . . . , 0) is non-zero. 

Theorem 1. Assume that \ai\ =0{i~^), f3 G (1/2,1), and that conditions (CI) and 
( C2 ) hold. Let p he any positive integer satisfying J > p + 1 > (2/3 — 1)~^- Then 



(3) 
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where = liniAr_+oo N ^ va.i'{QN,p) ■ Assume, furthermore, that > and that for some 
ai>0 

E[K{Xi)-K(Xi^e)?^0{£-°") as e^oo. (4) 

Then 

sup\P{N-^/^Qn,p <x)- <^>ix/a)\ = 0(iV-Q'/(3(2Q'+i)))^ ^g-, 
where Q' = ai A (2/3 - 1) A {{p + 1)(2/? - 1) - 1). 

Remark 1. (i) For the case of long-range dependence, if the power rank is one (e.g., K 
is linear and p = 0), then the formula for of Q' given in Theorem 1 is not applicable, even 
though the limit is Gaussian. This is consistent with the fact that in the circumstances, 
the normalized partial sums follow a non-central limit theorem, that is, the normalization 
constant is , with H > 1/2. For the general long-memory case where {p+ l)(2/3— 1) < 
1 with p>l, then one has non-Gaussian limiting distributions. Consider, for example, the 
case where K is univariate and has rank equal to 2. The limit is then usually referred to 
as the Rosenblatt distribution (Taqqu [25]), having a close form of characteristic function. 
A Berry-Esseen bound in these circumstances is feasible to obtain and will be discussed 
in a future paper. For the general case of nonlinear and non-instantaneous K and non- 
Gaussian {Xn}, however, the technical difficulties caused by lacking analytical forms of 
the characteristic functions of both the partial sums J2n=ii-^i'^ri, ■ ■ ■ ,Xn+d) — m) 
and their limit still remain to be overcome. When K{x) = a; is the identity function and 
Xn is linear without normality assumption. Hall [10] obtained the Edgeworth expansion 
for the sample mean. The result obtained relies on the fact that the limit is Gaussian 
and the characteristic function of the sample mean can be written down explicitly by 
utilizing the linear structure of Xn- (ii) The rate given in (5) can be slightly improved if 
condition (4) is strengthened to E[K{Xi,Xij)]'^'' 0(^-"('')) for some positive integer 
fe > 1 (as suggested by the referee). In order to achieve the improvement, one needs to 
deal with the complicated expansion of {Qn.p — Qn^p.i)^^ (see (7) for the definition of 
Qn,p,i) to compute its expectation. The details involved are tedious and highly technical, 
and are omitted in the present paper. 

An important implication of Theorem 1, as stated in the following corollary, is the 
case where the functionals are of power rank greater than one. We first note that if the 
power rank of if is p -I- 1 > 2, then for each l<r <p, all Bjj...j^ o A'oo(0)'s vanish and, 
as a result, Z^^r = and Qn ~ Qn,p- 

Corollary 1. Let (3 e (1/2,1) and p + 1 be the power rank of K. Assume conditions 
(Gl) and (C2) hold. If J>p+l> (2/3- l)-\. then 

N~'^/^Qn'^ N{0,a^) asN^oo. 
Furthermore, the convergence rate (5) holds if (4) is satisfied. 
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Theorem 2. Assume |a,;| = 0{i ^),f3> 1, and that conditions (CI) and (C2) hold. 
Then 

N-^'^Qn ^ N{Q,a'^) asN^oo. (6) 
Under assumption (4), (5) holds for Q' = ai A (2/3— 2). 

Remark 2. For condition (4), if A' is a polynomial function of degree D, then ai = 2/3—1 
provided that Eef-^ < oo. 

Remark 3. (i) Note that in Theorem 2 that a Berry-Esseen bound can be achieved 
regardless of the power rank of the functionals. (ii) For the short-range dependent {X„} 
considered in Theorem 2. if K{x) = x, an 0(iV-i/2) bound can be obtained by applying 
Theorem 2 stated in Dedecker and Prieur [6] under an additional dependence condition 
((7.19) in Dedecker and Prieur [6]) which is in terms of some new mixing coefficients 
and weaker than the traditional mixing-type coefficients. The condition, however, would 
require stronger summability restrictions on the innovation coefficients {oj}. It is still 
unknown whether the same 0(/V-i/2) rate can be extended to the case of general func- 
tionals K . 

Remark 4- We use two examples to further illustrate the theorems. Recall that our 
underlying process is defined as X„ = X^i^i where the Si are mean zero i.i.d. 
and have at least finite second moment and where \ai\ = 0{i~^) with /3 > 1/2. (i) Zero 
crossings. Assume that {X„} is long-range dependent with 1/2 < /3 < 1, and that the 
distribution of X„ is standard normal. Define the functional K as K{Xn, X^+i) = 1 if 
XnXn+i < and if X„X„+i > 0. In other words, ^^^^K{Xn, Xn+i) counts the total 
number of times that the sample path of {Xi, . . . , X^f} crosses zero. (See Kedem [16] for 
useful applications of zero crossings in time series analysis.) It is indicated in Ho and 
Hsing ([14], Remark 2 on page 1640) that when {Xn} is Gaussian and the functional is 
instantaneous (i.e., d = 0), the power rank is identical to the Hermite rank as defined in 
Taqqu [25]. This property can be seen to hold for the non-instantaneous case. Therefore, 
the power rank of K is two since its Hermite rank is, as computed in Ho and Sun [15], two. 
Suppose, further, that 2(2/3— 1) > 1. Then, by Corollary 1, the zero-crossing counts obey 
the central limit theorem with convergence rate as specified in (5), where ai can be shown 
to be 2/3— 1 since K{Xn, Xn+i) is of power rank two. (ii) Lag covariances. The functional 
we consider is K{XnT ■ ■ , Xn+d) = XnXn+d, which is frequently used when estimating 
lag covariances. While there has been much work done on central limit theorems on 
lag covariances for stationary sequences (see, e.g., Hannan [12], Hall and Heyde [11], 
Giraitis and Surgailis [9], Phillips and Solo [20], Hosking [13], Wu and Min [28], among 
others), the issue of Berry-Esseen bounds in the framework considered in Theorems 1 
or 2 has not been addressed before. Straightforward computation shows that the power 
rank of K is two. Corollary 1 can then be applied by the same argument as in the 
preceding example (1). Also, note that one can compute the value of bj-^_j^ = Bj^ j-^ o 
K[oo]iO, 0) by using formula (1), which can, in this particular case, be alternatively verified 
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by simply multiplying XnXn+d out and comparing the coefficients. For example, since 
K{xi, . . . ,Xd+i) = xiX(i+i, it follows from formula (1) that bij =0 for I < j < d and 
af for j ^ d + 1, which coincide with the corresponding coefficients in the expansion of 
XnXn+d by multiplication. More specifically, in the expansion of 

oo 

j^i-\-d i—1 

the second (or square) term follows the \/N central limit theorem since J^i^i loifli+dl < 
oo, while it requires the extra condition 2(2/3 — 1) > 1 for the same asymptotic normality 
to hold for the first (or cross product) term. 



3. Proofs 

Recall that 



N r 

ZN,r = X! X] '^]i-3r ° Koo{Q) W en+d-3, , 

n— 1 l<ji<---<j^<oc 5=1 



N 



>N,p - 



^X(X„)-^Zjv,., p>0. 



Define the truncated versions of Zj^^^. and Q^.p as 



N 



n=ll<ii<-<ir<t s=l 

and 

iV i 



QN,p,e = X K(li.n,e) — X ZN,r,l 
n—1 r— 

N 



(7) 



Also, define 

^n,jj = X„j — X,i_£, 1 < j < ^. 

The main building block of our proof is the following martingale decomposition of 
/^(X„)-E/f(X„): 

OO 

/^(X„) - Eif (X„) = X[X[,-i] (X„,,_i) - Ky] (X„,,)], (8) 
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where K\{)\ = K. Fix n,n',j,j' and write 

K[i]{'X..m^i) = E(A' (X„i)|J^,„+d— i-i), 

where J^s is the a-field generated hy ek,k < s. Suppose that n — j ^ n' — j' and, without 
loss of generahty, assume that n — j <n' — j' . Then 

E[-f^'[i-i](X„j-i) - i^[j](X„j)][A'y/_i](X„/j/_i) - A'[jv](X„/j/)] 
= E{[E(A'(X„)|^„+d-,) - E(A'(X„)|^n+d-,-i)] 

X [E{K{Xn')\Tn'+d-j') - E{K{Xn')\Tn'+d-j'-l)]} (9) 

= E{[E(/^(X„)|^n+d-,) - E(A'(X„)|^„+d-,-i)] 

X E[E(i^(X„0|^n'+d-j') -E(i^(X„Ol^n'+d-j'-i)|^„+d-j]} 

= E{[E(/^(X„)|^n+d-,) - E(/^(X„)|^n+d-,-l)] 

X [E(X(X„0|^n+d-j) - E(A'(X„0|^n+d-j)]} 

= 0. 



We now build a representation for Qn.p ~ QN,p.e, which will be central to the proofs, 
based on the martingale decomposition (8). The main step to achieve the representation is 
to use X]r=i (nl=i £n+d-j, )'^ji---jr ° ^^[oo] (0) foi' Suitable p to approximate the summand 
A'jj.i] (X„j_i) — A'[j](X„j) (for j > d + 1) by repeated applications of the martingale 
decomposition technique and differentiation. The task is carried out in a similar fashion 
for both the Qn,p and its truncated version Qn,pJ- Write 



p-i 



Q 



N,p - 



;N,p,i ' 



where 



n(t) 



'N,i,e 



N 



.n=l j^d+l 



t-1 N 



r—1 n—1 d+l<ji<---<jr'<oc s—1 



N 



-E E o A'[j^](X„jJ J|e„+d+i_ 

n=l d+l<ji<---<jt<oo s=l 



N oo 
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ip) 



N,2.i 



N,3,e 



iv) 



NAl 



r=l n=l d+l<ji<---<j,.<£ 



N 



s=l 
t 



n=l d+l<ji<---<jt<£ s=l 



0<t<p, 



N 



E E n^-- 

.n=l d+l<ji< - <jp<cc \s=l 



{B,,...,^o[i^[^.^](X„,,g-ir[^](0)]} 



JV 



E E n^"+'^-^ 

.n=ld+l<ji<---<jp<e \s=l 



N d 
_n=l j=l 



N d 
_n=lj = l 

p N r 

EE E i^j--> ° ^-(0) n 

r—ln—ll—ji<---<jr s—1 

jr->e+i 

p N 



EE E [Bji-j. ° (%] (0) - ^[oo] (0))] n '^+^-1^ 

r=ln=ll=ji<---<j,.<e \s=l 



By applying the same martingale decomposition technique used for (8) to Bj-^...j^ 
(/%](X„,jJ - is:[oo](0)), we have 



B,,...,,o(i^[^.^](X„.,J-/i[^](0)) 



312 

which implies that 



T.-L. Cheng and H.-C. Ho 



E n ^n-H ° {^n,n ) - ^[oo] (0)) 

d+l<ji<---<jt<^\s=l / 



(11) 



= E ( ]^h -Jt ° (^%+i-l](^n,it+l-l) -^[jt + i](Xnjt+i)). 

'i+l<jl<---<jt+l<oo / 

Similarly, repeating the same procedure, but replacing oo by we have 

d+l<ii< - <Jt<'' Vs=l / 

(12) 

= E ( n^"+''-J» ° (%t+l-l](^"Jt+i-l/) ^ %t+l](^n,Jt+l,^))- 

<i+l<Jl<-<Jt+l<As=l / 

With the help of (11) and (12), we can express T^^^ — t'^\ i as 



TV 



n=ld+l<ji< - <jf+i<oo \s=l / 



where 



A'[j_i](X„.j_i) - A'[j](X„j) - En+d-j ( E — j o A"[j](X„ 



^d+l 



d 



- A:[j](X„j^f) - £n+d-j I^Xj^J'^^^J ° -^''^[j] (^» J.' 
X/(j<£). 



We also write 



'-N.2,1 



N oo 

n=l j=(i+l 
N / ^ \ 

n=l d+l<ji< - <j"p<oo \s=l / 
N d 

n=l j=l 
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where 

M„,,- , = [%](X„,,) - X[^](0)] - [%](X„,,.£) - i^M(0)]/(j < ^) 

and 

Pn,j,e = [i^[j-i](X„j_i) - Ky]{Xn.j)] - (X„.j_i,^) - (X„ j.f < i). 

By repeating the same argument used in (9), we have 

cov{Lnj,e,Ln>j'^i) =0 if 77,- ^T^n'-j', (13) 



v,s=l / / \s=l 



(14) 

if n — is 7^ n' — for some 1 < s < f + 1 , 



if n — 7^ n — j'^ for some 1 < s < P, 



cov{Pnj,e,Pn',j',e) = ifn-j^n'-f (16) 
and, for any pair of real numbers Ci and C2, 

Cn r2 \ 

Ci J]^ £„_j, , C2 Y[ ^n'-j'^ =0 if n 7^ r2, or if ri = r2 = r, 
s=l s=l ) , ^ 

, , (17) 

but n — is ^ n — for some 1 < s < r. 

In order to estimate the growth rate of vai^QN p — Qn,p,i), we also need to compute the 
non-zero covariances for L„j g, ^^n,j,i and Pn,j,i- In the following, the results of Lemma 
4.1 of the next section are used to bound those covariances. Setting n — j = n' — j' , we 
obtain 



\m>t+l ) 



(18) 



by the second result of Lemma 4.1(i) and 



I cov(M„,,^,,,M„,, ,,,,)! <C^a^, £>1, (19) 
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by Lemma 4.1(ii). In addition, by (2) and Jensen's inequality, 

< C sup E[A-[,](Xi^,) - X[,](Xi,,- < CE[X(Xi) - K{X,,,)f. (20) 

i<j<e 

Combining the orthogonality properties (13)-(17) and the bounds (18)-(20), we can argue 
the same way as in Ho and Hsing ([14], proofs of Theorems 3.1 and 3.2) and obtain, as 
£ — > oo and uniformly for N , 

iV-ivar(r« ,) - 0(r (2/5-1)) (by (18)), 
iV-ivar(4*ty -4*\^,) = 0(r(2^-i)) (by (18)), 

var(r(P) _,) = 0(r "f+i^^^/j-i)-!)) (^y (19)) 

and 

iV-ivar(Tw,3,£) =O(r«0 (by (20) and (4)), 

where the bound 0(^~"i) should be o(l) if, instead of (4), the weaker condition (C2) is 
assumed. In addition, 

iv-ivar(r£,) = o(r(2^-i)), 

which follows from 

(B,,...,v o [if[^](0) - K[,]{0)] f < E(B,,...,„ o [A-[,](Xi^,) - A'[,](Xi,,-,)])2 

\i>e / 

The above inequality, which holds uniformly for all of the configurations of {ji, . . . , jV}, 
is implied by equation (1) and the first result of part (i) of Lemma 4.1 Consequently, as 
iV, £— s-oo, N~^vai{QM,p~ Qn,p.i) is o(l) under (C2) and 

7V-ivar(Qjv,p-Qjv,p,£) =0(^""""^"^''^"''^^+')^'^"'^"'^) (21) 
uniformly over N , if the stronger condition (4) is assumed. 

Proof of Theorem 1. We prove (5) by the blocking method (Bernstein [2]). Let 
An,Bn, and £jv be three increasing sequence of positive integers which satisfy 

(1) An + Bn <N and An + Bn = o{N); 

(2) Bjv — o{An) and £n = \cBn~\ , < c < 1 ( [•] is the greatest integer symbol). 

Here, Ajy and Bn, as in the standard setting of the blocking method, are the size of 
each block and the length between two adjacent blocks, respectively. The exact values of 
these three sequences A^^Bn and ai'c to be specified later. Recall T„(p, £) defined in 
(7). Define kM = N/{An + Bn) and, for s = 1, 2, . . . , [/cat] , 
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sAn + {s-1)Bn 

ri=(s-l)(Ajv+Sjv) + l 
s{An+Bn) 

ri=sAN + (s-l)Bjv) + l 

^^N.p = ^ niN^sipjN) and Bn,p^ ^ 6jv,s(p,^7v) 

and 

Rn,p — Qn,p,Im ~ (Mn.p + Bn,p)- 

Set Ajv = [iV"! and Bat = \N^} , 1 > a > 6 > 0. Then = \cN^} , < c < 1. For large N, 
since T„(p, ^^v), 1 < n < A^, are ^Ar-dependent, {mN.s{p, ^n), s = 1, . . . , \kN~\ } form an i.i.d. 
sequence. Then, given the result of Lemma 4.2, we can apply the Berry-Esseen theorem 
(cf. Theorem 7.4.1 of Chung [5]) to the double array {iTi]y s{p, £]y),N > 1, s = 1, . . . , [fc^vl } 
to obtain 

sup |P(iV-i/2Mw,p <x)~ $(ct-1x)| = 0(iV-(i-'^)/2). (22) 

X 

We assume for the moment that N~^^'^Qff,p is asymptotically normal with positive vari- 
ance CT^. The role of asymptotic normality will become evident later. Set Sn = , S > 
and Ajv,p = N^^/^{Qn^p — Mn^p)- Using the Petrov inequality, 

\P{U + V <x) -^{x)\ 

< sup \P{U <x)~ $(x-)| + + Pi\V\ > e) 

X V27T 



(Petrov [17]), where U and V are any two random variables and e is any positive real 
number, we have 

sup \P{N-^I'^Qn,p <x)- $(ct-^x)| 

X 

< sup \P{N-^^HIn,p <x)- $(a-ix)| + a-'^{V2^y^SN + P{\^N,p\ > 5n) 

X 

= /l+/2 + /3, 

where h = 0(iV~(i~°)/2) as already shown in (22), I2 = 0{N-^) by definition, and I3 
can furthermore be bounded by, using Chcbyshev's inequality, 

= ^3,1 + ^3,2 + ^3,3- 
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From (21), 

/3^i=0(Ar-W-2*)), 

where Q' = ai A (2/3-1) A ((p+ 1)(2/?- 1) - 1). Because {6Ar,s(p, ^w), s = 1,.. ., [fcAr]} 
also forms an i.i.d. sequence, we can, as justified by Lemma 4.2, apply the Berry-Esseen 
theorem and obtain 

/3_2=C'(iV-("-''-2'5)). 

It is easy to see that 

/3,3 = CI(iV-(l-'^-25)^^ 

Combining the above five rates that separately dominate Ii, l2, Is.i, l3.2, Is.a gives that 
the optimal choice of 6 will be the largest value that satisfies the following inequalities: 

l-a>2S, bQ'-26>S, a-b-26>S, l-a>36. 

After some elementary algebra, we get S ~ Q'/ [3(2Q' + 1)] . It is immediate from /3 = o(l) 
that (3) holds. The proof is completed. □ 

Proof of Theorem 2. The proof is similar to that of Theorem 1 with p = 0. Recall that 

Pn,j,e = [i^[-,_i](X„j_i) - K[j]{Xnj)] 

- j_i(X„j_i,f) - Ky]{Xn,jj)]Iij < I). 

Then 

var((5jv,o — QNfi,i) < Rn,i,i + Rn,24 + Rn,3,i, 
where, with j' = n' — n + j, 

Rn,i,i = ^Y. cov(P„,, 

n—lj—d-irl n'—n 

N N 00 
-^^,2,^ = 8^^ ^ COv(P„j,f,P„/j/,£), 
n— 1 n'—nj—£+l 

N d n+d-j 
n—lj—1 n'—n 

By (iii) of Lemma 4.1 and the fact that the \aj \ are summable, 

\i=e+i I \j=\ ) 
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and 



iV-ivar(i?jv,2/) < C ^ 



^0(^-2(^-1) 



\j=i+l 



Following the same argument as in proving N ^var(r7v,3/) = 0{£ "^), we have 

var(i?jv,3,£)=0(r"^). 

Hence, 

var(gAr,o - Qn^oj) = 0(r ("i^(2/3-2)))_ 
The rest of the proof is identical to that of Theorem 1, except that the rate is 
/3 1 ^ C'(Ar-('"3'-25)) ^j^j^ Q' = ai A (2/3 - 2). 

This concludes the proof. 



□ 



4. Technical lemmas 



Below are two technical lemmas, Lemmas 4.1 and 4.2, that were used in the preceding 
section to prove the two main theorems. Lemma 4.1 is the multivariate version of Lemma 
6.2 of Ho and Hsing [14]. The proof is omitted since it is similar to that of Ho and 
Hsing [14] and the main task is to directly apply the regularity conditions (CI) and 
(C2). 

Lemma 4.1. Assume that conditions (CI) and ( C2 ) hold. Let < ii + • • • + id+i < J ■ 
Then, for some universal constant C , 



(i) for j > d + 1 and i> j , 

-an+-+..+i(i,-^.,(Xij_A[^.](Xi,,,,))^2 



E 



< O > a- 

m=t+l 



and 



E 



n 2 



OO 



\va=j 



(ii) for i >d + \ and £> j , 



E 



< 



^ E«^n E 



\.m=e+l 
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(iii) forj>2, 

E{[/v[,_i](x„,,_i) - A-[,](x„,,)] - [if[,-i](x„,,_i,,) - A'[,](x„,,- < e)f 

\m=i+l ) 

In the preceding Lemma 4.1, we use the fact that there exists a constant C such that 
maxj_d_i<i<j+d+i \ai\ < C\aj\. 

In Lemma 4.2 below, a moment incquahty of fourth order for Qh(N).p,iN established 
so that the blocking method can be applied. To prove the lemma, the representation used 
in the previous section for Qh{N).p,iN i^^^ ^^'^ identity (10)) is needed. For the sake of 
presentation, we recall it below. 



N 



!N. 



n=l 
N 



r=0 



71 = 1 



p-1 



0(1) i\^/'C'(*+l) cit) ■) , ciP) I C I C' 



(P) 



t=l 



where the various S quantities are defined as follows: 



N 



and 



^NJ-.e ~ ^N.l.£ - E E ( j^Ji - it °-^r*jt+i, 

n=l d+l<ji<---<jt + i<oo \s=l / 



N oo 
n=l j=d+l 



where 



(23) 



l: 
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N / p 

E E n 

n=l d+l<ji<---<jp<oo \s=l 
N d 

EE^»j.^' 



where 



and 



p AT 



EE E ° (0) - A-[oo] (0))] n ^"+''- 

r=ln=ll=ji<---<jr<i \s=l 



Lemma 4.2. If conditions (CI) and (C2) hold, then 



^7v) < oo, 



(24) 



where £n and h{N) are increasing sequences of positive integers less than N which diverge 

to +00. 



Proof. In view of the representation (23), it sufRces to show that (24) holds for each of 



'-^/i(7V),l,^jv' 



At) 



qip) 



h(N),4,tN' 



We only prove the case of 5^]^^ 2 since the other cases are similar or simpler (for 

the case of •S'^j^-) if)- Because the index s in S^j^-^ ^ o^^Y 1^^^ ^ finite range, we can 
assume that it is fixed. Using the orthogonality property given in (15), we get 

{ n=l d+l<ji<---<jp<e\s=l / ) 



f h(N)-l 

<clh{N) E 

I fci .fc2 .fe3=0 d+l<ji <---<Jp<oo 



n + + k2){ju + fca)) 



-0 



(25) 
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h{N)-l / p \ 

h{N) (l[(^u{ju+k))-nijpijp+k)) 

k=0 d+l<ji<---<jp<oc\u=l / 



for some constant C independent of N and £. To derive the right-side of (25), we make 
use of part (ii) of Lemma 4.1, as well as the fact that the coefficient Aj-^^ui • • ■ ■Ajp,up in 
Bjj...j,, is bounded above by C(ji • • • jp)~^ ■ Because of the assumption {p+ 1)(2/3— 1) > 1, 



h(N)-l I p \ 

E E H (^"0" + ^^y^ ^hA3v + k))- 

k=0 2<ii< - <j"p<oo \m=1 / 



.(/3-1/2) 



= 0(1). (26) 



Hence, the second part inside the braces on the right-hand side of (25) is of order 
0{h'^{N)). Similarly, the first part of the right-hand side of (25) is bounded by 



C h(N)-l 

h'\N)lh{N) Y E 

I fc=0 2<ii<-<jp<oo 



t[iJui3u + k)y 



[jpUp + k)]-^^-'^'-^ 



= 0{h{N)). 

ling (26) am 
is thus completed. 



(27) 



Combining (26) and (27) gives E(S'[^jy^ ^ ej^ = 0{h'^{N)). Hence, (24) follows. The proof 

□ 
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